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[57] ABSTRACT 

A system generates and arranges animation sequences of 
articulated characters for review and selection by a user. 
Motion of articulated characters is based upon input 
parameters, such as torques at joints of the character. The 
system can be used to select appropriate parameters to 
obtain desirable motion of the articulated characters. The 
system generates a set of input vectors containing param- 
eters of the motion. The input parameters are then processed 
to determine animation sequences and corresponding output 
vectors. The output vectors include characteristics of the 
motion. The input vectors are selected to provide a dispersed 
set of output vectors. A large niunber of random input 
vectors can be generated and then culled to leave a dispersed 
set of output vectors. Alternatively, a set of randomly 
generated input vectors of a predetermined size are ran- 
domly pertiu-bed, to further disperse the output vectors. The 
system includes an interface for representing the output 
vectors and animation sequences in a manner which is easily 
reviewable by a user. The output vectors are displayed so 
that positions represent distances between the output vec- 
tors. The user can then select specific output vectors so that 
the corresponding animation sequence is displayed. 
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SYSTEM FOR DETERMINING MOTION Subsequently, the computer generates more random lights, 

CONTROL OF ARTICULATED LINKAGES biasing the generation process towards the user's selections. 

The user then selects from the new random set. This process 

This application is a continuation of U.S. application Ser. can be extremely time consuming. If sophisticated rendering 

No. 08/805^18, filed Feb. 27, 1997, now abandoned. 5 programs, such as ray tracing or radiosity, are used, produc- 
tion of an image based upon the lights takes considerable 

FIELD OF THE INVENTION time. The image-rendering process must be repeated each 

The present invention relates to a system for generating changed, 

and manipulating input vectors and corresponding output The inverse -design approach has also been used in an 

vectors in nonlinear systems. More particularly, it relates to attempt to determine lights to achieve a specified lighting 

a system for generating potential parameters and outputs, eflfcct. However, the user must be able to articulate desired 

organizing and displaying the outputs to be browsed by a illumination characteristics of an image. This requires a 

user, and for selection of specific input vectors having sophisticated user experienced in lighting design. It also 

desired output-vector features. requires a user who can formulate lighting objectives in an 

1^ understandable format In addition to requiring a sophisti- 

BACKGROUND OF THE INVENTION cated user, existing computer systems and processes that 

One of the major difficulties in computer simulation is determine lights from the desired illumination limit the 

input parameter selection. Sets of input parameters define lighting possibilities for an image. 

outputs based upon a mapping fiinction given by the stimu- For example, "Radioplimization — goal-based rendering'*, 

latioo. While certain output effects might be desired, finding Proceedings of SIGGRAPH 93, pp. 147-54, by Messrs. 

a set of input parameters that yield a desirable output is Kawai, Painter, and Cohen, describes a system for deter- 

diflScult and tedious for many processes. Generally, the mining lights from subjective impressions of illumination 

mapping functions are multidimensional, nonlinear, and entered by a user. The system uses optimization techniques 

discontinuous. Thus, one cannot calculate specific input to determine optimum lighting parameters to meet the 

parameters which have the desired output. Even if the input entered illumination impressions. However, the user must 

parameters could be determined for a given desired output, enter a limited set of possible light positions, which severely 

the output cannot always be described. limits the lighting options which are considered. Similarly, 

T\vo general computer-assisted processes have been Schoeneman, Dorsey, Smits, Arvo and Greenberg disclose a 

developed for parameter selection: interactive evolution and system in "Painting with Light", Proceedings of SIG- 

inverse (or optimization-based) design. GRAPH 93, pp,143-46, which uses optimization techniques 

Examples of interactive evolution are disclosed in K. ^ determine fights to achieve certain pixel intensity levels 

Sims, Artificial Evolution for Computer Graphics, COM- ^"^^'"^ '"'^ ^V^^em reqmres the user to be able 

PUTER GRAPHICS (Proc. of SIGGRAPH 91), v.25, to mput the pixel mtensity levels for the entire image. It also 

319-328 (July 1991) and S. Todd and W. Utham, Evolu- 35 requires a limited set of Ught positions to be entered by the 

tiomry Art and Computers, (1992). In such systems, the ^^^^ ^ determine the optimum lights, 

computer explores possible parameter settings, and the user Another system, disclosed in Poulin and Fournier, "Lights 

subjectively selects desirable outputs. The computer gener- from Highlights and Shadows", Proceedings of the 1992 

ates and displays outputs generated. The user then selects Symposium on Interactive Graphics, pp. 31-38, allows the 

certain outputs for further exploration. The computer bases 40 ^° specify the desired locations of highlights and 

subsequent selections of input parameters based upon the shadows. This system uses geometric techniques to deter- 

user's selection of certain corresponding outputs. However, mine optimum light positions and types in order to achieve 

the system becomes less useful as the computational com- the desired highlights and shadows. As with the previously 

plexity of the mapping increases. If the process cannot discussed systems, this system requires a sophisticated user 

generate outputs from different parameters in real time, the 45 who has a set lighting pattern in mind. Adjustments to the 

system is imusable because the user must wait for each specified lighting pattern have to be reprocessed in order to 

output before selection. determine a new set of light positions. 

Examples of inverse design systems are discussed in K. Therefore, a need exists for a system for selecting input 

Sims, Evolving Virtual Creatures, COMPUTER GRAPH- parameters and generating outputs which is easily manipu- 

ICS (Proc. of SIGGRAPH 94) 15-22 (July 1994) and J. K. 50 lablc by the user to obtain a desired result. A need exists for 

Kawai, J. S. Painter, and M. F. Cohen, "Radioptimization — a system which allows the effects of dianges in input 

Goal-Based Rendering," COMPUTER GRAPHICS (Proc. parameters to be easily reviewed by a user. A need exists for 

of SIGGRAPH 93) 147-154 (August 1993). With inverse a system that allows a large set of potential parameters to be 

design, the user inputs an objective function over the out- considered and combined. Finally, a need exists for a system 

puts. The computer then searches parameter settings so as to 55 that is usable by persons having limited experience in the 

optimize the objective function. However, the objective mapping of inputs and outputs, 
function must be mathematically stated in order to perform 

the search. In many cases, an objective function cannot be SUMMARY OF THE INVENTION 

developed to describe the desired results. Often, it is not The deficiencies of existing parameter-setting systems are 

po^ible to determine the qualities or feamres of an output sq substantially overcome by a system for implementing a 

which makes it desirable. selection process according to the present invenUon. The 

These various approaches have been or could be used in system of the present invention generates a number of 

the context of selecting, placing and adjusting lights in a potential parameter sets as input vectors and creates an 

three-dimensional virtual environment. Under an output vector corresponding to each input vector. Input 

interactive-evolution approach, the user repeatedly selects 65 vectors are computed to form a set of output vectors dis- 

ceriain randomly generated lights to add to a scene. As each persed so as to cover the space of possible outputs. The 

light is added, the image of the invironment rendered again. outputs are organized for review by the user. 
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According to one aspeci of the inv'entioa, a large number FIG. U illustrates a user interface according to the 

of potential input vectors are generated randomly over an invention with respect to opacity and color transfer fiinaions 

identified set of potential parameters. A low- resolution for volume rendering. 

output image is generated as an output vector for each input FIG. 12 illustrates a second user interface used with 

vector. 5 volume rendering. 

According to another aspect of the invention, the low- FIG. 13 illustrates a user interface with respect to anima- 

resolution output images are used to eliminate various input tion of particle motion. 

vectors. A group of input vectors is selected which best flG. 14 iUustrates a user interface according to the 

spans the output vector space. A higher rcsoluuon output invention with respect to a double-pendulum animation 

image or vector may tten be created for each of the selected apphcation 

outputs. ^ . . . , FIG. 15 illustrates an animation character for use in 

Accordmg to another aspect of the mvention, a dispersed determining motion according to the present invention, 
set of output vectors is determined through quasi -random 

selection of input vectors. During random selection of DETAILED DESCRIPTION 
inputs, the corresponding output veaors are analyzed to ^5 ^ iUustrates a general computer system useable in 
determine dispersion. The sampling of parameters forming connection with the present invention. A memory 2 stores 
the input vectors can then be adjusted over lime to generate ^^^^^^ converting input vectors to output 
a more dispersed set of outputs. Alternatively, a set of vectors. A central processing unit (CPU) 1, connected to the 
parameters can be permrbed randomly. The resulting set can memory 2, processes the input vectors, generates, eliminates 
then be substituted as the mput vector if it makes the set of 20 organizes output vectors, and operates a user interface to 
output vectors more disperse. ^y^^ o^p^j images or vectors. A display 5 is connected to 
According to another aspect of the invention, the output the CPU 1 to display output images in connection with the 
images are organized to be easily browsed by the user. Using user interface. The user inputs information through a key- 
graph theory, the output vectors can be organized into board 4 or mouse 3 to set parameters in the input vectors and 
subsets, the elements of whidi are most similar to each other. to operate the interface. 

A user interface displays the sets to allow selection of the example of setting lights for a computerized image, 
miages. The user selects a first output from a display of j^e memory 2 stores a scene to which the Ughting wiU be 
representauve outputs for each set. Representative output ^pp^^ ^^^^ ,^1,^^^ jhe hghting. The central process- 
vectors of subsets are then displayed for further selection. ^^g unit (CPU) 1 processes the scene, generates, eUminates 
FmaUy, the user can select a specific output vector. ^nd organizes fights and rendered images of the scene, and 

Alternatively, the output vectors can be arranged graphi- operates the user interface to select lightings to create an 
cally based on similarity metric for the output vectors. The image. The display 5 displays images in connection with the 
user can then select certain output vectors for more detailed user interface. The user inputs information through a key- 
review of images until a desired output vector effect is board 4 or mouse 3 to set fighting parameters and to operate 
achieved. tlje interface for fighting selection. 

According to another a^ect of the invention, a user may FIG. 2 iUustrates the overaU process of a system accotd- 

select various output vectors, which are then combined to ing to an embodiment of the present invention. FIG. 2 shows 

produce a final composite output vector with desired char- the process for selectbg parameters of the input vectors, 

acteristics. Output vectors can be selected and deselected 40 such that the set of output vectors has some desired char- 

until the desired output image effects are achieved. acteristics. In step 1000, various sets of input parameters are 

BRIEF DESCRIPTION OF THE DRAWINGS ^^l^^^^"*' ^^""^ parameters forms an input vector. The 

selection may be random or may be according to some 

FIG. 1 is a computer system which can be used to predefined process. After selection of the input parameters, 

implement the present invention. 45 a dispersed set of output images are determined based upon 

FIG. 2 is a block flow diagram for operation of the system the input vectors (step 1010). Different processes can be 

according to the present invention. used for determining the dispersed set of output images, as 

FIG. 3 illustrates a basic image to which a lighting system discussed more fiilly below. In some of the processes, 

according to an embodiment of the present invention can be information about the dispersion of output vectors repre- 

applicd. 50 senting the images is remmed to the selection of input 

FIG. 4 is a flow diagram of the process of the present vectore(step 1015) for further input parameter selection, 

invention appfied to a lighting system. output vectors are determined, they are 

no. 5 is a flow diagram of the process of generating (^*"P ^^^) ^ '^^^ ^'^^^^ ^ "^J 

lights in connection with the process of FIG. 4. V^s^. The arrangement process depends 

ic-flj- ri_ ri. 55 Upon the charactensUcs of the output vectors and unages, 

FIG. 6 .s a flow diagram of ihe process of selecting a ^^e desired selecion process The arranged oufpu 

spanning set of Lgbts m conneCion wi.h the process of FIG. j^^g^ (^,^p for selection by a 4r 

(step 1040). After selection, the display of the output images 

RG. 7 IS a flow diagram of the process of arranging fights may be modified to account for the selection or deselection 

m connection with the process of FIG. 4. of certain outputs. 

HG. 8 iUustrates a user interface used to select fights in piG. 4 illustrates the overall process of the present inven- 

a fighting system according to an embodiment to the present tion in conjuncfion with creating fightuig for an image. The 

mvcntion. ijjpu{ vectors and output vectors are generated according to 

FIG. 9 illustrates a user interface according to the inven- a first embodiment of a dispersion process so as to create a 

uon with respect to fighting modification of photographs. 65 dispersed set of output vectors. At step 100, the system 

FIG. 10 is a flow diagram of parameter set creation generates a set of possible fights. The process for creating 

according to another embodiment of the present invenfion. fights 100 is iUustrated in FIG. 5. Each fight includes up to 
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three parameters which represent the light: a position, a light 
type, and a light target. The position represents a location 
within the image scene, it may be within the image or &Dm 
outside the image. light positions arc determined based 
upon light-hook surfaces. The user inputs the hght hook 5 
surfaces (step 205) and then the system generates light 
positions at random locations on those siufaces (step 210). 
FIG. 3 illustrates an image which can be illuminated with the 
present invention. The image includes two walls 10, 11 and 
a floor 17. Any of these may be a light-hook surface. 
Additionally, the scene inherently includes two other walls 
and a ceiling, \i^ich are not within the view. These may also 
be hght-hook surfaces. 

At least one light type is generated for each light position. 
Dififerent light types have different illumination character- 
istics. Light types might include point Hghts, area lights, and 
spot lights of different intensities. The user can input the 
different light types (step 205) which can be used. The 
system may generate each of the light types at each location, 
or may randomly select light types for each location from the 20 
set of entered types. 

For directional lights, such as spot lights, the direction 
information is provided in the form of a position for the light 
to face. The user can input a set of light-target surfaces. The 
directional light will be automatically generated to point to 2s 
a random location on a randomly selected target surface. In 
the illustration of FIG. 3, the chair, table, object on the table, 
shelf, or object on the shelf may be the light target. 
Alternatively, the walls, floor and ceiling, whether in the 
image or behind the viewer might operate as light targets as 30 
weU. 

Based upon the light-hook surfaces, light types and light- 
target surfaces, the system will generate a set of potential 
lights (step 225). The parameters of the Lights are the input 
vectors for the system. For maximum potential lighting 35 
selection, preferably the number of potential lights will be 
large, such as thousands, each corresponding to an input 
vector Since a user cannot easily review thousands of light 
images, (nor can such a high number of high-resulution 
images be easily generated and stored) the number of 40 
potential lights must be reduced. Preferably, the number of 
lights can be reduced while maintaining the widest set of 
potential lights in the light space. The generation and culling 
process represent a first embodiment of the diversion 
process of the step of selecting input vectors (step 1000) in 45 
FIG. 2. To reduce the nimaber of lights, low-resolution 
images (output vectors) are created for each light (step 105, 
FIG. 4) using ray tracing or any similar techniques. The 
images are stored in the memory 2. In one embodiment, a 
low-resolution image has a resolution of 32x25 pixels. A 50 
low-resolution image is used to limit the time necessary to 
create the images. The low-resolution images are used to 
cull the potential lights, at step 110, to select a set S of 
images which spans the light space. The process for culling 
the lights is illustrated in FIG. 6. 55 

First, images which have little illumination are removed 
(step 250). To do this, the pixel intensities for an image are 
simimed. If the total intensity is less than a selectable 
threshold value, the image and its corresponding light are 
removed. Second, a set of images are selected which most 60 
broadly covers the lighting space. An iterative process is 
used to select the set of images and lights. At each iteration, 
an image is selected that has pixel intensity valiies which 
differ most from a closest image in the set of images already 
selected. The iterative process is repeated until a predeter- 65 
mined number of images have been selected. Since each 
newly selected image differs the most from the complete set 
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of selected images, the final set best spans the space of 
potential lights. 

Possible steps for performing the iterative process are 
illustrated in FIG. 6, steps 255 to 325. In this figure, set P 
refers to the set of images for potential fights which have not 
yet be selected; each image in the set P is referenced as a P 
image. Set S refers to the set of images which have been 
selected and each image in set S is referenced as an S image. 
A first image is transferred from set P to set S at step 255. 
The image may be randomly selected or a predetermined 
one of the images, such as the first image generated. An 
image is selected from set P and firom set S (steps 260 and 
265). The S and P images arc compared to determine how 
close they are. Various methods can be used to determine 
closeness. According to one embodiment of the invention, a 
difference measure would be used. The difference measure 
is given by 

where Y(x, y) is the luminance level of the pixel at location 
X, y in the image. Other measures, such as an inner product 
of the light images, can alternatively be used to judge 
closeness. 

The comparison value is compared to a closest value (step 
275), and closest gets the value of the comparison, if it is 
smaller (step 280). The comparing step and adjustment of 
the closest value is repealed for each image in set S. The 
iterative process represented by steps 265-290 represents 
determining the least difference between the images in set S 
and the selected image of set P. This process is repeated for 
each image in set P to determine the least difference between 
set S and each P image. The P image which differs most from 
a closest S image is determined by steps 295-315. The 
closest value of a current P image is compared with a 
differing value at step 295. If the closest value is greater than 
the differing value, then the differing value is assigned the 
closest value (step 300) and the current P image is selected 
(step 305). The closest value represents the best similarity 
between a ctirrently selected P image and the images in set 
S. If the current P image is more different than any of the 
previously considered images, it becomes the selected 
image. After all of the P images have been considered, the 
selected P image is transferred to set S at step 320. The entire 
process is repeated until set S is complete (step 325), i.e., a 
predetermined number of images have been selected from 
set P. According to an embodiment of the invention, set S 
would include 584 lights. 

Once a set of images of a predetermined size that best 
spans the entire lighting space has been selected, high- 
resolution images are created for each light corresponding to 
the set of images at step 115 (FIG. 4). According to an 
embodiment of the invention, the images have a resolution 
of 512x400 pixels. The high resolution images require more 
time to generate than the low-resolution images, but permit 
better closeness comparisons and more acciu^te review by a 
user Since the mmibers of lights have been reduced, the time 
for generation of the high resolution images for these lights 
is significantly less than for the low-resolution images of all 
the originally generated lights. 

The number of remaining lights are still large in relation 
to the capability for a user to review them. By arranging the 
images appropriately, the system allows the user to more 
eflSciently review and select input and output vectors. Dif- 
ferent processes can be used to organize the images or output 
vectors. A first embodiment of an arrangement, and corre- 
sponding user interface, is shown with regard to the lighting 
spaces in FIGS. 7 and 8. The lights are hierarchically 
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partitioned and organized at step 120 to permit efficient 
review. V'arioiis methods can be used lo partition and orga- 
nize the images. A specific graph theory process descnbed in 
U.S. Pat. No. 3,617,714, incorpwraied herein by reference, 
can be used for partitioning and organizing the images. 5 
Using this graph theory process, the vertices are the images 
and the costs of interconnections are the similarit>' values of 
the images. Of course, other measxires of similarity could be 
used. According lo another embodiment of the invention, a 
set C of images are selected from set S which are most lO 
distinctive from each other. The remaining images are then 
separated into subsets according to their similarity to the 
images in set C. In one embodiment, images can be included 
in more than one subset. Alternatively, each subset may be 
mutually exclusive. The process is then repeated for each of 15 
the subsets. As with the culling process, the similarity of 
images is measured by the difference value of equation [1] 
from the high-resolution images. 

RG. 8 illustrates a first embodiment a user interface 
useful by a user for reviewing the organized images, select- 20 
ing and combining images. This embodiment of the user 
interface is particularly applicable to hierarchically arranged 
output vectors. The interface includes a set of hierarchy 
image levels 410, 420, 430, a palette of selected lights 440, 
and a full -sized combined image 450 on the display 5. The 25 
images for the first level in the organized hierarchy are 
displayed on a first level 410. The user can then select one 
of these images using the keyboard 4 or mouse 3. Once a 
first-level image is selected, the images of the next lower 
level are displayed at the second hierarchical level 420. The 30 
user can tben select one of the images in the second level, 
which causes the third level 430 to be displayed. Although 
the interface is illustrated with three hierarctiical levels of 
eight images each, any number of levels or sizes of levels 
can be used. The number and sizes of levels determines the 35 
size of set S in the culling process. With three levels of eight 
images each, 584 lights can be selected if images may be in 
more than one subset. 

Any of the displayed images may be selected to be 
included in the palette of selected lights 440, by using a 40 
drag-and-drop technique with the mouse 3, or other method. 
The selected lights in the palette are then combined to create 
the full-sized, combined image 450. The combined image 
can be created relatively quickly using the additive nature of 
light based upon the high-resolution images previously 45 
generated. A method for combining lights is discussed in J. 
Dorsey, J. Arvo, and D. Greenberg, "Interactive Design of 
Complex Time-dependent Lighting", IEEE Computer 
Graphics and j^pUcations, pp. 26-36 (March 1995), incor- 
porated herein by reference. A slider scale 441 can be used 50 
to adjust the contribution of the light for each image to the 
combined image. Although FIG. 8 illustrates white lights, 
colored lights could also be used. The interface can display 
a palette for the user to select a color for each light in the 
selected palette of lights 440. 55 

The vector generation, organization and browsing process 
can be used with various other types of data in order to 
provide information. In applying the process to other types 
of data, the selected input factors and output factors are 
chosen to efficiently achieve desired results. In one 60 
application, similar to determining lights for lighting spaces, 
lighting of photographs can be adjusted with the present 
system. In the lighting spaces example above, the scene is 
designed by the user, inchiding the generation of specific 
three-dimensional object in the scene, their placements, and 65 
their colors. With photographs, the three-dimensional infor- 
mation can be extracted from the photographs themselves. 
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In order to do this, multiple photographs of the same scene 
are needed. Preferably, for simplicity, only one of the 
photographs of the scene will be modified. Of course, all of 
the photographs could be modified in a similar manner. FIG. 

9 illustrates the display using photograph data. 

The multiple photographs are used to extract three- 
dimensional information from the photograph. Using infor- 
mation in the photographs, the system determine what 
objects are present and their shapes and positions. As with 
the lighting space example, the parameters of input vectors 
represent lights in the system. Similarly, the output vectors 
are the pixels of the photographs with lighting added. 
However, in creating the displayed images, the pixels of the 
original photograph are modulated by the light and dark 
spaces of the output-vector image. This results in lighting of 
the photograph which accounts for the structure of objects in 
the photograph. As with synthetic scene Ughting, a large 
number of lights are generated and the culled to determine 
a broad set of input vectors covering the lighting space. The 
output images are organized hierarchically in groups in 
order to be easily browsed by the user. FIG. 8 illustrates the 
user interface used to browse and combine lighting images 
for the photographs. 

FIG. 10 illustrates a second embodiment of the dispersion 
process for determining a dispersed set of output vectors. In 
this embodiment, a predetermined number of input vectors 
are generated at step 1110. The number corresponds to the 
desired number of outputs to be reviewed by the user. Rather 
than generate a larger nimsber of vectors and then cull out 
certain vectors, in this embodiment, the generated input 
vectors are permrbed to provide a more dispersed set of 
outputs. At step 1120, one of the input vectors is randomly 
selected, and is then randomly modified at step 1130. An 
output vector is determined for the modified input vector 
(step 1140). The modified input vector replaces one of the 
existing input vectors if it is better, i.e., results in a more 
dispersed set of output vectors. The dispersion of the output 
vectors can be gauged in various manners. In one method, a 
nearest-neighbor approach is applied to characteristics of the 
output vector. The distance to a nearest-neighbor of the 
output vector of the modified set is compared with the 
nearest-neighbor distance of the output vector of both the 
worst input vector (i.e., output vector with closest neighbor) 
(step 1150). If the new output vector is further from its 
neighbor than the worst output vector, it replaces the worst 
vector (step 1155). If not, the output vector is then compared 
with the output vector of the input vector which was 
perturbed (1160), If the output vector corresponding to the 
new input vector is further from its nearest- neighbor than the 
old output vector, it replaces the old output vector (step 
1165). The process is repeated until complete (step 1170). 
Completeness can be determined in a variety of ways. A 
predetermined number of perturbations could be made, or 
perturbations could be done until no vector is replaced for a 
specified number of iterations. 

An example of data useful with the second embodiment of 
the dispersion process is volume rendering. In volume 
rendering, input data are voxels representing densities of 
materials. The input data can come from a variety of sources. 
For example, the input data may be generated by a computer 

10 represent things such as electron distributions in mol- 
ecules. A display interface for electron distributions is illus- 
trated. Similarly, in the medical area, CAF-scan information 
can be used to generate density information for volume 
rendering. A display interface with medical data is illustrated 
in FIG. 11. The three-dimensional data is converted into 
two-dimensional image data by use of a transfer function. 
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Depeoding upon the desired output, the transfer function 
Doay relate to different variables such as opacity and color. 
The input vectors of the system designate parameters of 
transfer functions. For example, the input vector consists of 
the parameters representing slopes and breakpoints in the 
transfer function, or division areas in a color transfer func- 
tion. A transfer function 1255 is illustrated in FIG. 12. The 
di£ferent input vectors are applied to the original voxel data 
to generate the two-dimensional images to be displayed. The 
images are the output vectors in this embodiment. As 
discussed above, in generating the input vectors with the 
second dispersion process, parameters for a set of input 
vectors are randomly determined. The input vectors are then 
randomly perturbed. If the perturbation of a vector results in 
a more dispersed set of output vectors, then the perturbed 
vector is incorporated. In the lighting and photograph 
examples, the output vector consisted of all of the pixels in 
the output image. Dispersion was therefore dependent upon 
differences between all the pixels in the images. However, 
the output vector may relate to other information or to a 
portion of the image. The input and output vectors are 
selected in order to enable the user to review the specific 
information of interest. With opacity and color transfer 
functions, it has been found that a dispersed set of output 
vectors can be obtained without using all of the output pixels 
as the output vector. In particular, eight specific pixels have 
proven generally sufficient to determine a dispersed set of 
input and output vectors. The specific eight pixels could be 
selected at random. However, preferably, the user would 
identify the location of the eight pixels so as to have a 
dispersed set of output vectors particularly relating to the 
areas of interest in the volume rendering. 

FIG. 11 illustrates a second embodiment of a user inter- 
face for arranging output vectors which can be used with 
volume rendering. In this arrangement, the display includes 
two portions, a thumbnail display panel 1200 and a plurality 
of image panels 1220 surrounding the thimibDail display 
panel 1200. For this arrangement, each fall-sized image is 
also rendered as a thumbnail sketch 1210, such as a small, 
low-resolution image. The thumbnail sketches are arranged 
in the display panel 1200 in a manner which tends to equate 
the distance between thumbnails with the distance between 
associated output vectors. The distance between output 
vectors and corresponding thumbnail sketches on the display 
panel 1200 can be determined in various manners. For 
example, one method is illustrated in K. M. Hall, "An 
r-dimensional quadratic place algorithm," Management 
Science, 17 (3) : 219-229 (November, 1970), incorporated 
herein by reference. If the distance between two vectors (d,y) 
is normalized to lie in the range of 0-1, Hall's method 
computes coordinate vectors X-{Xi, X2, . . . , X^y) and 
Y-(Y3 , Y2, . . . , Yjy) representing the X and Y positions on 
the display of the output vectors 1-N. The coordinates are 
determined such that X^ X-1, Y^ Y-1, and (1-d,;^) 
[(X,-X,/4<Y,-Y/] is minimized. HaU's method is funda- 
mentally a projection from a high-dimensional space onto a 
two-dimensional space. Although this projection cannot be 
done without some loss of information, the placement of the 
thumbnails reflects the underlying structiue of the output 
vectors well enough to allow effective browsing. 

When the output vector corresponds to pixels in the image 
the full-size image or thumbnail sketch could be used as the 
output vector for calculating distances. It is more efficient to 
determine distances between output vectors by using the 
full-size version of the images since the full-size images are 
aheady created for viewing, they do not need to be sepa- 
rately generated. The additional data in the full-sized images 
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provide more accurate distances than the basic data in the 
thumbnail sketches. This produces better placement of the 
thumbnail sketches for more effective browsing by the user. 
The display panel 1200 allows effective browsing of the 

5 thumbnails 1210. The display panel 1200 can be manipu- 
lated by using the mouse or other control device to view 
certain portions of the display panel. The panel can be 
panned and zoomed in order to look at certain locations or 
thumbnails. As stated previously, specific thumbnails can be 

10 selected to be displayed in larger scale in the image panels 
1220 surrounding the display panel 1200. The location of 
specific images 1210 in the image panels 1220 is under the 
control of the user and is unrelated to the generation of the 
images. In this manner, no hierarchical structure needs to be 

15 created for the images as in the first embodiment of the 
display interface. The relationships between the thumbnail 
sketches and full-size images displayed in the image panels 
1220 need to be represented. According to one method, 
selection of a thumbnail highlights the corresponding image 

20 in the image panel. Similarly, selection of the full-size image 
highlights the corresponding thimibnail. Also, illustrated in 
FIG. 10, lines can also be used to connect each image with 
its corresponding thumbnail sketch. 
FIG. 12 illustrates use of a display for providing addi- 

25 tional information about certain images. When the informa- 
tion is to be displayed, additional windows appear over the 
display panel to illustrate the additional information about a 
specific image. The image is displayed in large format 1240. 
Also, the information about the image is separately dis- 

30 played 1250. For example, as illustrated in FIG. 11, in 
images relating to the opacity and color transfer functions, 
the additional information may be the function itseff. For 
lighting analysis, the additional information may be the 
location and type of light. Of course, other information 

35 could be similarly displayed. 

In each of the preceding applications of the present 
invention, the input vectors have included parameters relat- 
ing to portions of an image, and the output vectors have been 
specific images. In each case, the output vector has included 

40 all or a portion of the pixels in a specific image. However, 
output vectors are not limited to images or pixels. Rather, the 
output vector may be any data relevant to the information 
being explored by the user. In particular, the present inven- 
tion can be applied to animation sequences in order to 

45 achieve specific characteristics of motion during the anima- 
tion sequence. If all of the pixels in all of the images in the 
animation sequence were used as the output vector, the 
output vector would be extremely large and not easily 
computable or useable. Furthennore, the set of pixels them- 

50 selves are not particularly useful in determining character- 
istics of motion relevant to the user. Using pixels to deter- 
mine dispersion may not result in an actual dispersion of 
output vectors with regard to the relevant issues. Therefore, 
the output vector for the animation sequence should repre- 
ss sent the characteristics relevant to the user. 

In one embodiment, the present invention is applied to 
selecting an animation sequence representing particle 
motion. FIG. 13 shows a user interface in connection with a 
particle motion animation sequence where the particles are 

60 generated from one space ship towards a second space ship. 
The input vectors can include a large number of parameters 
defining the motion of the particles, including particle cre- 
ation rates, life times, accelerations, directions, beam 
widths, etc. In analyzing the particle motion, the user may 

65 set certain parameters, such as generation point and 
direction, and allow other parameters to vary. Alternatively, 
the input vector may include all parameters relating to 
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particle motion, so that all parameters may vary. The output 
vector includes characteristics of the particle motion at 
specified times in the sequence. Parameters making up the 
output vector may include numbers of particles, the centroid 
of the particle cloud, average velocity of particles, and 5 
spread of particles. The particle attributes may be deter- 
mined at one specific time or at various times during the 
animation sequence. For example, in one embodiment, the 
attributes of the particles are determined at an ending time 
(t) and midway through the animation sequence (t/2). 10 

The second embodiment of the dispersion process has 
been used for determining a dispersed set of output vectors 
for the particle motion animation sequence. Thus, a set of 
input vectors is determined by randomly selecting param- 
eters in the input vectors. The input vectors are processed to j5 
determine the corresponding output vectors. The distances 
between output vectors are determined in the miiltidimen- 
sional space. The input vectors are then randomly perturbed 
and new output vectors arc generated. If the new output 
vector results in a more dispersed set of output vectors, it 
replaces either the worst output vector or the output vector 
corresponding to the perturbed input vector. The perturba- 
tion process is repealed until relatively dispersed set of 
output vectors has been generated, typically a set number of 
times. The second embodiment of the interface has also been 
applied to the particle motion animation sequence, as illus- 25 
tratcd in FIG. 12. As discussed above, the output vectors are 
processed to provide a two-dimensional projection of the 
distances between output vectors in the multidimensional 
space. Thumbnail sketches of a composite image for each 
animation sequence are used on the display to represent the 30 
animation sequences. The user can then select specific 
sequences to be placed as high-resolution images in the 
image panels of the interface. The high -resolution images 
may be represented either as a still image representative of 
the animation sequence, or a periodically repeating version 35 
of the fiill animation sequence. In either event, the user may 
also select one of the images to be displayed in a larger 
format in an additional window 1240 as a full animation 
sequence. 

In another embodiment, the present invention is applied to 
synthesis of motion for articulated figures. FIG. 14 illus- ^ 
trates the user interface in connection with a two-joint 
model. FIG. 15 illustrates a muhi-jointed character to which 
motion can similarly be applied. In both cases, the input 
vector represents the torques applicable at the joints at 
specific times. The torques do not have to be constant, and 45 
may vary over the total animation sequence. Additionally, 
the torques may have some type of sinusoidal input, or may 
represent certain values relative to positions and values of 
other torques in the image. As with the particle-motion 
example, some of the parameters of the motion may be set 50 
by the user so as not to be part of the input vector. The output 
vectors may be any values which are representative of the 
motion. The output vector may include information such as 
the centroid of the figure, velocities of particular elements, 
(average, maximum or minimum), or angles between certain 
elements in the figure. As with particle motion, the articu- 
lated motion of both the two-joint and the multi-jointed 
figure have been applied to the invention using the second 
dispersion process and the second user interface. In each 
case, a set of initial input vectors is generated by randomly 
selecting the variable parameters which control the motion. 
The output images are then generated and the relevant 
output vectors determined. The perturbation and replace- 
ment process is repeated so that a dispersed set of output 
vectors is achieved. The output vectors are then processed to 
determine distances between them and projected onto the 65 
two-dimensional space in the display panel 1200. The user 
then may select certain thumbnails sketches of the output 



638 

12 

vectors so that the images are displayed in the image panels 
1220 as noted above. The displays may be of a still screen 
of each animation sequence or may be the entire animation 
sequence itself. The user may also select specific animation 
sequences to be displayed in full on a larger window 1240. 
In this manner, the user may find a desired type of motion 
for a figure without having to be able to define the actual 
parameters for that motion or the desired effect in the 
motion. 

A portion of the source code, written in C and Tcl-Tk 
programming languages, corresponding to the system of the 
present invention is attached. 

Having now described a few embodiments of the 
invention, it should be apparent to those skilled in the art that 
the foregoing is merely illustrative and not limiting, having 
been presented by way of example only. Numerous modi- 
fications and other embodiments arc within the scope of one 
of ordinary skill in the art and are contemplated as falling 
within the scope of the invention as defined by the appended 
claims. 

What is claimed is: 

1. A system for generating animation sequences of char- 
acter motion comprising: 

means for randomly generating a set of input vectors, the 
input vectors representing random parameters that con- 
trol motion of at least one character in an animation 
sequence; 

means for generating a set of output vectors and a set of 
animation sequences, each output vector and animation 
sequence corresponding to one of said random input 
vectors; 

means for displaying said output vectors and animation 
sequences for selection by a user. 

2. The system of claim 1, wherein said means for gener- 
ating input vectors includes: 

means for generating randomly generating parameters for 

a first set of input vectors; 
means for generating corresponding output vectors; 
means for determining diversion of the output vectors; 
means for removing input vectors from the first set of 

input vectors corresponding to output vectors which are 

least disperse. 

3. The system of claim 1, wherein said means for gener- 
ating input vectors includes: 

means for generating a set of input vectors; 

means for generating a set of output vectors correspond- 
ing to the set of input vectors; 

means for determining dispersion of the set of output 
vectors; 

means for randomly perturbing one of the input vectors to 
generate a perturbed output vector; and 

means for replacing one of the output vectors with the 
perturbed output vector if replacement makes the set of 
output vectors more disperse. 

4. The system of claim 1, wherein said means for dis- 
playing includes means for representing each of said output 
vectors at a location on a display corresponding to a position 
relative to the other output vectors. 

5. The system of claim 4, wherein said means for dis- 
playing further includes: 

means for receiving a user input for selecting at least one 
output vector; 

means for displaying at least one animation sequence 
corresponding to said at least one output vector. 

« * * * * 
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